Active and Non-Active Volumetric Information Spaces to Supplement Traditional Rehabilitation

The purpose of this paper is to inform on findings from a mature body of research titled SoundScapes. The goal was to define, create and question sensor-based ICT systems, techniques and methods to supplement traditional rehabilitation. Following initial biofeedback/sensorimotor tests, a non-invasive (non-wearable/ gesture-based) motion-sensitive sensor system enabling human performance control of computer-generated multimedia was originated. Digital music making via motion data was originally investigated as a strategy to train physical impairment. Gesture-control of painting, robot control, and video games followed. Commonly referred to as Virtual Reality therapy, the work was applied within wide arrays of participants marginalized by their disability. Outcomes point to an optimal solution as an adaptive flexible system that could be mixed and matched to an individual’s profile coupled with an intervention approach to maximize a participant’s development. Emergent are models toward establishing valid and replicable techniques and methods to evolve new digital test batteries to assess clinical evidence. Human-machine, human-human interactions, and information exchange are core of the research. Published patents resulted from the work. Conclusions summarize how accessibility, inclusion and rehabilitation have been influenced by such noninvasive sensor-based gesture-control of multimedia. Another main conclusion is the need for new strategies of staff training with ICT due to their key role in the rehabilitation process. Contemporary adoptions of gesture-controlled video games and creative recreation in rehabilitation indicate ongoing potentials and influence. ACM Classification: J.4, J.5, K4.2